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ABSTRACT 

An informal study explored the difficulties of 
writing teachers who are asked to set aside preferred ways of viewing 
student writing for state-mandated criteria when serving as 
evaluators for state-mandated tests, such as Florida's College Level 
Academic Skills Test (CLAST) . Twelve high school, community college, 
and university-level writing teachers completed questionnaires and 
were interviewed to determine whether they prefer intuitive or 
sensory perception, and to learn how they evaluate student writing. 
Results indicated that many writing teachers continue to focus on 
limited, product-based criteria. Furthermore, state-mandated testing 
such as Florida's CLAST essay examination could quite possibly be 
having an extremely negative impact on what is being taught in 
writing classrooms. Writing teachers who serve as evaluators of 
product-based writing tests are becoming increasingly comfortable 
with applying out-datod, product-based standards to writing, and are 
even finding themselves applying these standards to their own 
students' writing. Entire English departments are being trained in 
CLAST scoring strategies and are applying its limited, product-based 
criteria. Writing teachers should not have to set aside preferred 
ways of viewing student writing when aslced to serve as evaluators for 
state-mandated tests. (PRA) 
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Deborah L. Coxwell 

The Clash Between Teachers' Personal Views 
of Student Writing 
and Views laposed by the State 

Conteaporary personality theory and research suggests that 
there are two ways of perceiving — sensing and Intuitive. 
Personality theorists explain that when using sensory perception, 
we pay attention to the inforaation provided to us directly 
through our five senses, and when using intuitive perception we 
pay attention to things other than concrete inforaatlon — to 
associations or hunches beyond the actual sensory data. In 
Personality Theo ry and th e Tea ching of CoBposlt lon, John 
DlTiberlo and George Jensen point out that as aany as 90% of 
college English teachers say prefer Intuitive perception, but 
that we all can and do use both kinds depending on the situation. 
1 would like to bring to your attention a situation which 
requires aany English teachers to put aside their preference for 
intuitive percept 1 on--f or considering possibilities suggested by 
the text--and Instead, consider only the concrete inforaatlon 
before the*. The situation to which 1 aa referring Is the 
scoring of essay exaas for purposes of assessaent such as the one 
which aakes up part of Florida's College Level Acadealc Skills 
Test, coaaonly referred to as the "CLAST." 

Since 1984, Florida law has required that studeiiits pass the 
CLAST before being awarded an associate of arts degree or being 
adaltted to upper-division status In a state university in 
Florida. Currently, three other states — Georgia, Texas, and New 
Jersey — have laws which require college students to pass slallar 
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ezaainat Ions, and Many other states are considering passing such 
legislation. The Florida Oepartnent of Education's CLAST 
Technical Report states that "the CLAST Is part of Florida's 
continuing effort to assure that Its students acquire the 
acadealc skills expected of thea" (1). This report goes on to 
explain that the CLAST Is an achleveaent test consisting of 
subtests In essay, English language skills, reading and 
■atheaatlcs. Each of the subtests, except for the essay. Is 
coaposed of ault 1 ple-cholce questions. CLAST essays are scored 
hollstlcally by high school, coaaunlty college, and university 
English teachers. Raters are Instructed to read each essay 
quickly to get an overall sense of the paper and to assign a 
holistic score of 1, 2, 3, or 4. Each essay Is scored by at 
least two raters, and consequently, a coablned score of eight 
points Is the highest possible score an essay aay receive. In 
order for an essay to pass, it aust receive a coablned score of 
at least four polnts--each rater aust give It a alniaua score of 
"2." 

CLAST essay raters are Instructed in the criteria they are 
to use in Judging the essays. Each essay should contain a 
clearly stated thesis which is developed logically and in 
sufficient detail. Sentences and paragraphs should be "well- 
foraed." Language should be used "appropriately and 
effectively," and standard practices in spelling, punctuation, 
and graaaar should have been followed. Raters are to consider 
only the written texts. They are not to consider whether or not 
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It Is fair to expect students to write an essay which Beets these 
criteria In 60 alnutes on a topic they have never before 
considered. A rater Is not supposed to worry that she teaches 
process, not product — that she teaches writing as a gradually 
evolving, recursive process which requires adequate tlae for 
conception, Incubation, discovery, drafting, and revising — but 
then her students are told they cannot proceed with their college 
educations unless they are able to write an "acceptable" essay 
according to CLAST criteria In a 60-Blnute period. While rating 
CLAST essays, a writing teacher Is not supposed to bother hlaself 
with the knowledge that In his classrooa he eaphaslzes the 
laportance of his students becoming Involved In and with the 
subject they have chosen and that he teaches thea to view writing 
as thinking, drafting, and revising, but then his students have 
to pass an essay test which requires thea to be proficient ''^t 
quick topic selection, foraulalc organization, graaaar, »iid 
aechanlcs. A rater Is not to speculate that the student text she 
Is reading was aost assuredly written by soaeone whose native 
language Is not English, and that If only given the opportunity 
to take the piece of writing through another draft or refer to a 
handbook or dictionary, the essay would be "correct" enough to 
pass CLAST standards. Raters are not to think about the 
possibilities of a piece of writing upon revision. They are 
instructed to consider only the text before thea, how 
successfully that text aeets the established criteria, and how 
the text coapares to the "range finders" presented in the 



training sessions. During tbese sessions, saaple student essays 
are presented which are representative of the types of papers 
which should receive Is, 2s, 3s, and 4s. Eapbasls in these 
sessions is on becoaing adept at placing the "appropriate" score 
on the piece of student writing. 

What scrts of difficulties and conflicts do teachers of 
writing have to deal with when asked to put aside their preferred 
ways of viewing student texts, and Instead, use state-aandated 
criteria to assess student writing. This Is the Issue 1 aa 
currently studying. 

Twelve teachers of writing at the high school, coaaunlty 
college, and university levels who also serve as raters of CLAST 
essays were Involved In the prellalnnry research 1 will share 
with you. They completed questionnaires which supplied me with 
two types of data: 1) Information which Indicated whether they 
tend to prefer Intuitive or sensory perception, 
and 2) Inforaatlon relating to how they go about evaluating 
student writing. Additional Inforaatlon was obtained through 
personal Interviews. I asked these writing teachers to explain 
how they typically go about evaluating pieces of writing composed 
by the students they teach and how that typical aethod of 
evaluation differs froa the way they are Instructed to score 
CLAST essays. 1 asked thea what sorts of conflicts they found 
theiaselves having to deal with when asked to put aside their 
usual ways of evaluating student writing and Instead, assess 
student writing using the criteria specified by the state. 



The data I collected revealed tbat tvo-tnirds of the English 
teachers Involved In the study clearly prefer Intuitive 
perception, and the reaalnlng one-third Indicated that they have 
no preference for one way or the other — that the way they 
perceive depends on the specific situation. This Inforaatlon 
case as no surprise. 

Data froB the writing teachers also revealed a wide range of 
preferred aethods for evaluating texts written by the students 
they te^ch. While several of the writing teachers described 
product -or lented evaluative techniques which focus on surface 
features of student writing, others focus on the Ideas the 
student writers present In their papers and on hnw successfully 
those Ideas are conveyed. Others pointed out that the criteria 
they use to evaluate student writing change froa one writing 
asslgnaeni to another, and several teachers explained that their 
evaluation procedures focus primarily on the writing process. 

One high school teacher explained, "In the first reading 1 
look for a thesis, then see If It Is adhered to, supported, and 
restated In the conclusion. In a second reading I seek out 
■Istakes In sentence structure, punctuation, spelling, syntax, 
and graaaar." A university professor explained his usual aethod 
of evaluating student texts by saying, **I read for an 
Introduction, body, and conclusion. Then 1 read for general 
content and graaaatlcal structure." 

!n contrast to these pr oduct -or 1 ent ed approaches to 
evaluation are responses that Indicate a strong eaphasls on the 
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Ideas contained In the piece of writing and on tiow successfully 
the writer conveys those Ideas. One coaaunlty college teacher 
explained: "My prlaary eaphasls la on the content of the paper. 
1 don't copy-edit anyaore. not a achool aara.** A university 

professor stated that her prlaary focus Is on how well the writer 
conveys his/her Ideas to a reader: "First, I read the papers 
bollstlcally with an eye toward the writer's purpose and thesis 
and how well these are developed and articulated. A second 
reading helps ae aake suggestions, ask questions, and point out 
graaaatlcal errors (If necessary). My final evaluation considers 
how well the writer conveyed his/her Ideas." 

Two writing Instructors, one at the university level and 
another who teaches high school, explained that the criteria they 
use for evaluating student writing are likely to change froa one 
paper to another, depending on what they have been focusing on in 
the writing class. "As 1 read an essay for evaluation, 1 
generally try to aeasure it against whatever criteria 1 have been 
using In class," one of thea stated. "Those criteria aay 
therefore change froa asslgnaent to asslgnaent. Once I have read 
several papers, I tend to use thea--loosely — as an additional 
standard by which to Judge subsequent papers." He went on to 
explain that It is laportant to hla that bis students realize the 
subjectivity Involved in evaluation: "Recognizing the 
subjectivity of auch evaluation, I prefer to acknowledge that 
subjectivity openly by using lots of '1 think' or '1 
like/dislike' coaaents." 
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Two other writing teachers --one at a coMunlty college and 
another at the university level — coMented that their focus In 
evaluating student writing Is not on individual pieces of writing 
but, Instead, on the writing process: "I read their drafts as 
they write and respond to the ldeas--the content — In early 
drafts, and then to organization, structure, and finally 
■echanlcs In later drafts of the papers," one of the teachers 
explained. "1 don't grade Individual pieces; 1 grade portfolios 
of work at the end of the semester that reflect their writing 
processes throughout the tern." 

In response to the question regarding how their typical 
■ethods of evaluating student writing differ froa the way they 
are Instructed to rate CLAST essays, the Bajorlty of the writing 
teachers explained that the primary difference Is that when 
evaluating CLAST essays, there is tlae for only one reading of 
the paper and that they are not allowed to wake any Barks, 
coMBents, or suggestions on the piece of student writing. With 
CLAST evaluation, they are Instructed to read hoi 1st 1 ca 1 J y, 
keeping In Bind the state-specified writing criteria. Sevpral 
writing teachers Involved in the study stated that while they 
norBally focus on Batters of structure and correctness when 
evaluating texts written by their students, they try to focus on 
no one specific criteria when scoring CLAST essays since they are 
instructed to view the papers holist Ically, not allowing any one 
criteria to carry Bore weight than another. 

Another coBBent concerning the differences between the 
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■anner In which they typically go about evalu<itlng writing 
coaposed by itudents they teach and the way they are Instructed 
to rate CLAST easays relates to the fact that CLAST writing Is 
first draft/last draft writing. A coMunlty college writing 
teacher coaaented that when he rates essays written by students 
he teaches he looks beyond the text, thinking of ways the writer 
■ight laprove the writing In the next draft; but when assessing 
CLAST essays, he explains, "What you read Is what you get, so 
there's no point In thinking about what the piece needs upon 
revision." A unl vers 1 1 y-level writing teacher who evaluates 
portfolios of student writing at the end of each seaester stated 
that the way she evaluates writing coaposed by the students she 
teaches and the way she assesses CLAST writing are totally 
different. "The CLAST essay has specified criteria It aust be 
aeasured against and a nuaerlcal systea of four broad categories 
for scoring. This approach to assessaent Is nothing like what I 
do In ay classrooa where the eaphasls Is on the process of 
wrltlng--on drafting and revising and the students developing as 
writers 

Another writing teacher whose classrooa approach to 
evaluation is quite different froa CLAST assessaent procedures 
explained that when scoring CLAST essays, he tries to turn 
hlaself Into a "grading aacblne": "For CLAST scorings, I try to 
turn ayself Into an lapersonal aeasurer — that is, I bold the 
essay up to the standards and assign It the 'appropriate' score. 
I try to reaove subject Ivlt y--t o turn ayself Into an objective 
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■achlne of sorts. I therefore often assign scores that differ 
froB scores I would assign In a classrooa setting." 

While these teachers coHented on how very different their 
preferred ways of evaluating student writing are froa the CLAST 
assessaent procedures, others coaaented on the effect the CLAST 
assessaent procedures have had on the way they evaluate their 
students' writing. Five of the 12 writing teachers Involved In 
this prellalnary research coaaented that the assessaent 
techniques they have becoae adept at using through their 
experiences as CLAST graders have affected the way they go about 
evaluating essays written by their stuof^nts. A writing teacher 
at the university level coanented: "I think that 1 have (perhaps 
unconsciously) transferred the approach taught for CLAST essay 
grading over to ay regular grading: I have tended progressively 
to think less and less In teras of separate evaluative categories 
(graanar/content , etc.) In deteralnlng grades." A coaaunlty 
college teacher stated, "Often I grade hollstlcally without thH 
second reading, especially with laproaptu essays written by 
students In ay classes." While these teachers referred to using 
holistic scoring techniques in their classrooas, others referred 
specifically to applying product -based CLAST criteria to their 
students' writing. One teacher explained that the all the 
aeabers of her departaent have been trained In CLAST assessaent 
techniques and that they use the CLAST criteria to assess In- 
class essays written by their students. "Our entire departaent 
has learned how to score In-class papers using the saae criteria 
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that are used when rating CLAST essays," she explained. 

Finally, 1 asked each of the writing teachers what sorts of 
conflicts they found theiiselves having to deal with when asked to 
put aside their usual ways of evaluating student writing, and 
Instead, assess CLAST essays using the criteria specified by the 
state. Much to ay surprise, only four of the 12 writing teachers 
Involved In the preliminary research felt that they had any 
conflicts to deal with. Of these four, two teach writing at the 
high school level, one at the coa«unlt> college, and the other at 
the university. The other eight writing teachers explained that 
they have no problems with keeping the two tasks completely 
separate. Of the teachers who described conflicts, two of them 
are writing teachers who focus on matters of grammar and 
correctness in evaluating thPtr students' writing. They 
explained that even though they are Instructed to hoUstirnMy 
view CLAST essays, attaching no more weight to one specified 
criteria than to another, this is not always easy for them. "In 
reading CLAST essays, 1 flnrt myself particularly watching for 
comma splices, sentence fragments, and spelling et'rors. 1 
probably attach more Importance to these than CLAST Scoring 
Guidelines suggest." Another teacher who prefers a product- 
oriented approach to the teaching and evaluating of student 
writing stated: "1 know I tend to put more value on spelling and 
grammar errors than some other CLAST graders." One of the 
writing teachers who emphasizes a process approach to writing in 
his classroom revealed that even with CLAST scorlnr., he tends to 
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overlook surface errors and focus prlaarlly on the Ideas the 
student is trying to get across. "While reading CLAST essays, I 
focus on the the aessage — the content — the Ideas the student Is 
trying to convey. I'm hardly the surface error school Hara 
either with ay classrooa evaluation or on the CLAST." He went on 
to say that when scoring CLAST essays, he has to realnd hlaself 
not to think about what the piece of writing needs upon revision. 
"I have to constantly realnd ayself that this Is It—that there 
Is no possibility of another draft." 

The aajorlty of the teachers, however, eight of the 12, 
reported that they have no difficulties In considering only the 
text before thea when scoring CLAST essays. "I approach the two 
tasks with such wholly different attitudes," stated one teacher. 
"One has absolutely no effect on the other." Another teacher 
explained that be aakes a conscious effort not to allow his 
preferred aethod of evaluating student writing to affect the way 
he evaluates essays for purposes of CLAST: "1 think it's 
soaethlng 1 fight agalnst — i try to suspend my 'teacher self' to 
becoae an 'evaluator' when rating CLAST essays.' Other teachers 
who reported no conflicts were those teachers who stated that 
they often apply CLAST standards to the writing of their own 
students. "Instead of ay usual classrooa evaluation procedures 
affecting the way 1 rate CLAST writing, 1 think It's the other 
way around. More and aore frequently, I 'a using CLAST procedures 
and techniques to score ay students' writing — especially their 
In-class writing." 
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What do I conclude from tbe findings of my prel Inl nary 
research? First, that Bore extensive research needs to be 
conducted regarding the clash between teachers preferred ways of 
viewing student writing and views Imposed by the state. The 
prellalnary findings 1 have shared with you were obtained froa a 
s«all group of 12 writing teachers froia the North Florida area. 
While teachers fron the high school, coaaunlty college, and 
university levels were represented, aore extensive research needs 
to be conducted with a such larger, aore representative group 
from a aore widespread geographical area. 

hrom this prellalnary data 1 also conclude that even thouf:h 
current coaposltlon research and theory eaphaslzes the laportance 
of teaching process, not product, that research and theory have 
not yet actually had the widespread lapact on what goes on In 
writing classrooB.<; that aany of us would like to think they have 
had. Many writing teachers at all levels continue to focus on 
Halted, product -based criteria. 

And Bost laportant of all, 1 conrlurte that stat e-aandat ed 
testing such as Florida's CLA'jT essay examination could quite 
possibly be having an extreaely negative lapact on what is being 
taught and stressed In writing classrooas. Writing teachers who 
serve as evaluators of product -based writing tests are becoaing 
increasingly coafortable with applying out-dated, product -based 
standards to pieces of writing, and are finding theaseives 
applying these standards to their own students' writing. But the 
lapact of writing tests such as Florida's CLAST goes far beyond 
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affecting the Instruction and evaluative techniques of those rho 
serve as CLAST raters. Entire English departaents are being 
trained In CLAST scoring strategies and are applying product- 

■ 

based CLAST standards to their students' writing. I aa in no way 
laplylng that there Is anything wrong with training writing 
teachers to use holistic scoring techniques. It Is the Halted, 
product -based criteria behind the particular holistic scoring 
procedures 1 aa speaking out against. 

in Teac hi ng and Assessin g Wr Ulng. Edward White points out 
that "When the testing of writing is done properly, It supports 
teaching both practically and conceptually. Involves teachers In 
test design, and helps bring recent discoveries about the 
teaching of writing Into the classroom" (2). Writing tests such 
as Florida's CLAST are not doing that. Teachers of writing whose 
■ethnds are based on current rhetorlaJ research and theory should 
not have to set aside their preferred ways of viewing student 
writing when asked to serve as evaluators of st at e-«andat ed 
t est s . 
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